Computer-Aided Specification of Quality Models for Machine Translation Evaluation
نویسندگان
چکیده
This article describes the principles and mechanism of an integrative effort in machine translation (MT) evaluation. Building upon previous standardization initiatives, above all ISO/IEC 9126, 14598 and EAGLES, we attempt to classify into a coherent taxonomy most of the characteristics, attributes and metrics that have been proposed for MT evaluation. The main articulation of this flexible framework is the link between a taxonomy that helps evaluators define a context of use for the evaluated software, and a taxonomy of the quality characteristics and associated metrics. The article explains the theoretical grounds of this articulation, along with an overview of the taxonomies in their present state, and a perspective on ongoing work in MT evaluation standardization.
منابع مشابه
The Correlation of Machine Translation Evaluation Metrics with Human Judgement on Persian Language
Machine Translation Evaluation Metrics (MTEMs) are the central core of Machine Translation (MT) engines as they are developed based on frequent evaluation. Although MTEMs are widespread today, their validity and quality for many languages is still under question. The aim of this research study was to examine the validity and assess the quality of MTEMs from Lexical Similarity set on machine tra...
متن کاملA new model for persian multi-part words edition based on statistical machine translation
Multi-part words in English language are hyphenated and hyphen is used to separate different parts. Persian language consists of multi-part words as well. Based on Persian morphology, half-space character is needed to separate parts of multi-part words where in many cases people incorrectly use space character instead of half-space character. This common incorrectly use of space leads to some s...
متن کاملHuman Effort and Machine Learnability in Computer Aided Translation
Analyses of computer aided translation typically focus on either frontend interfaces and human effort, or backend translation and machine learnability of corrections. However, this distinction is artificial in practice since the frontend and backend must work in concert. We present the first holistic, quantitative evaluation of these issues by contrasting two assistive modes: postediting and in...
متن کاملMachine Translation: Theory, Applications, and Evaluation. An Assessment of the State-of-the-art (Buchvorstellung)
Machine Translation (MT) has made a comeback during the 1990s. Though systems, as to their Iinguistic performance, are much what they were 10 years earlier, there have been significant changes on the technical level. Systems that were once costly and running on mainframes and expensive workstations only are now licensed for rather modest sums to run on personal computers. The comeback of MT has...
متن کاملComputer-Aided Language Processing
The invited talk will introduce Computer-Aided Language Processing (CALP) as an emerging area of practical interest and significance and will present experiments of several CALP applications which show that while no quality is lost, much time is saved when employing CALP tools. Computer-aided language processing: context, history and examples The past years have seen a variety of promising Natu...
متن کامل